AD-A238  538 


mil  mu  mi  in; 


THE  ASYMPTOTIC  DISTRIBUTIONS  OF 
AUTOREGRESSIVE  COEFFICIENTS 


T.  W.  Anderson 
Stanford  University 


u  fit; 


JUL2  2  1391  -i 


TECHNICAL  REPORT  NO.  26 
APRIL  1991 


U.  S.  Army  Research  Office 
Contract  DAAL03-89-K-0033 
Theodore  W.  Anderson,  Project  Director 


Department  of  Statistics 
Stanford  University 
Stanford,  California 


Approved  for  Public  Release;  Distribution  Unlimited. 


91-05301 


mi  Mini: 


fit 

I  /  0 

5  oft*.  t 

*  CYTvv  * 


91 


17  026 


THE  ASYMPTOTIC  DISTRIBUTION  OF 
AUTOREGRESSIVE  COEFFICIENTS 


T.  W.  Anderson 
Stanford  University 


f-  Sc  1 


0  >  • . '  \  t 


■J*.'. 1  ..  .  1  "  C  d 

J-i.t  *  icaiw. 


Sc  _ _ _ _ _ 

■'lsi.r'.out  ion/ 


!  i 

[Avail  i 

.ad /or 

Dipt  | 

SpBO  i*\x 

TECHNICAL  REPORT  NO.  26  \ 

APRIL  1991  1'' 

L _ ! 

U.  S.  Army  Research  Office 
Contract  DAAL03-89-K-0033 
Theodore  W.  Anderson,  Project  Director 


Department  of  Statistics 
Stanford  University 
Stanford,  California 


Approved  for  Public  Release;  Distribution  Unlimited. 


1.  Introduction.  A  stationary  stochastic  process  {x<}  with  finite  second  moment 
has  mean  £xt  =  y  and  covariance  or  autocovariance  sequence 


(1.1)  £(xt  -  y)(xt+a  -  y)  =  0(3),  s  =  0,±l,.... 

The  covariance  sequence  can  be  expressed  in  terms  of  the  variance  of  the  process 
<r(0)  and  the  correlation  or  autocorrelation  sequence 

(1-2)  =  s  =  0’±1 . 

If  the  process  is  Gaussian,  the  mean  and  the  covariance  sequence  or  alternatively 
the  mean,  variance,  and  correlation  sequence  completely  specify  the  process. 

Inference  about  the  process  may  be  based  on  a  sample  of  n  consecutive  obser¬ 
vations  xi , . . . ,  x„.  The  sample  covariance  sequence  may  be  defined  as 

j  n—h 

(1.3)  Cfc  =  c-h  =  -  VVx*  -  y)(xt+h  -  y),  h  =  0,1,..., n  —  1, 

n  L — ' 
t- 1 

if  y  is  known  and  as 


(1*4)  ch  =  c—h  =  ~  ^  1(Jt  —  ®)(*t+fc  ®)>  h  =  0, 1, . . . ,  n  —  1, 

n 

if  y  is  unknown;  here  x  =  5Z”=i  ®t/n<  The  sample  correlation  sequence  is  defined 
as  rfc  =  c/t/co  or  as  rj[  =  c^/cj,  h  =  0, ±l,...,±(n  —  1),  in  the  two  cases.  If 
the  process  is  Gaussian,  the  sample  mean  and  covariance  sequence  or  alternatively 
the  sample  mean,  variance,  and  correlation  sequence  constitute  a  sufficient  set  of 
statistics.  In  any  case  the  sample  correlations  may  be  used  for  making  inferences 
about  the  pattern  of  dependence  in  the  process. 

Under  general  conditions  on  the  process,  any  finite  set  of  correlations  is  asymp¬ 
totically  normally  distributed  as  n  — ►  00.  More  precisely,  the  limiting  distribution 
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of  v^(n  —  pi), . . .  ,y/n(rn  —  ph)  for  arbitrary  H  is  normal  with  mean  0  and  a 
covariance  matrix,  say,  W.  If  x«  is  a  linear  process 


(1.5) 

OO 

xt  =  p  +  ^yivt-i,  t  =  0,±1, ..., 

«=0 

with  E£o  7?  <  oo, 

(1.6) 

<  oo 

i=0 

and  {ut}  a  sequence  of  independently  identically  distributed  random  variables  with 
£vt  =  0  and  £v7  =  cr2,  the  elements  of  W  are 


OO 

(1.7)  Wgh  =  ^  +  Pi — g  ~  2prPj)(Pr+fc  +  Pr—k  ~  2 PrPh)i 

r=  1 

The  covariance  and  correlation  sequences  of  {xt}  defined  by  (1.5)  are 

(1.8)  <r(h)  =  <r(-h)  =  a2  7i7<+ft»  h  =  0,1,..., 

i=0 

(1.9)  ph  =  p.h  =  ^g07‘77>.  '>  =  0.1 . 

2L„=o  7i 

If  {i<}  is  second-order  stationary  and  purely  nondeterministic,  it  can  be  repre¬ 
sented  as  (1.5)  with  the  v<’s  having  mean  0  and  variance  a7  and  being  uncorrelated. 
In  this  situation  the  v£s  are  the  innovations  and  the  errors  in  prediction  one  step 
ahead. 

A  type  of  process  that  has  been  particularly  useful  is  the  autoregressive  process 
which  satisfies  the  stochastic  difference  equation 

p 

(MO)  ^2pj(xt-j-fi)  =  vt,  <  =  ...,-1,0,1,..., 

>=o 
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where  0o  =  1.  If  the  t>t’s  are  independently  identically  distributed  and  the  roots  of 


(l.n)  E^p_i  =  o 

«= 0 

are  less  than  1  in  absolute  value,  (1.10)  defines  a  stationary  process.  If  £vt  =  0 
and  £v2  —  a1  <  oo,  {rt}  has  a  representation  (1.5),  Sxt  =  p,  and  the  covariance 
and  correlation  sequences  are  given  by  (1.8)  and  (1.9),  respectively.  In  the  case  of 
p  =  1  pi  =  — /?!  and  ri  or  rj  is  an  estimator  of  —$i. 

A  serial  correlation  coefficient  (of  order  one)  is  n  or  r*  or  a  close  approximation 
to  ri  or  r* .  It  is  of  particular  interest  as  providing  a  test  of  the  null  hypothesis  that 
a  sequence  of  observations  is  independently  distributed.  The  alternative  hypothesis 
is  (often  unstated)  that  the  observations  come  from  an  autoregressive  process  of 
order  1.  The  doctoral  dissertation  of  Geoffrey  Watson  (1952)  dealt  with  serial 
correlations;  hence  this  present  paper  is  related  to  the  early  work  of  Watson. 

In  the  early  ’40’s  at  least  four  people  nearly  simultaneously  and  essentially 
independently  derived  the  distribution  of  some  form  of  serial  correlation  when  the 
xt’s  were  independently  normally  distributed  with  mean  0  and  variance  a2  (p  — 
0  and  /?i  =  0).  John  von  Neumann  (1941)  treated 


(1.12) 


E;i2(r<  -  rt- 1)2 

_  o  o  Et=2(Jt  -  *)(*«-!  -  g)  +  f  (*1  -  ^)2  +  § (*n  -  j)2 

£r=i(*‘-*)2 


The  fraction  on  the  right-hand  side  of  (1.12)  is  a  serial  correlation  coefficient. 
Tjalling  Koopmans  (1942)  studied  the  distribution  of  r\  and  approximations  to 
the  distribution.  R.  L.  Anderson  (1942)  found  the  distribution  of  the  circular  form 
(suggested  by  Harold  Hotelling) 


(1.13) 


-  5)(zt-i  -  x) 
Et=i(xt  -  x)2 


where  xo  =  xn.  Wilfrid  J.  Dixon  had  independently  obtained  many  of  the  results. 
(They  were  to  be  included  in  his  doctoral  dissertation,  but  because  of  the  publica¬ 
tions  of  the  others  he  changed  his  dissertation  topic.)  A  number  of  new  results  were 
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published  subsequently  [Dixon  (1944)].  These  authors  also  derived  some  asymptotic 
distributions  of  the  serial  correlations,  which  sire  asymptotically  equivalent  to  r*i . 

R.  L.  Anderson  and  T.  W.  Anderson  (1950)  observed  that  the  distribution  of 
the  circular  serial  correlation  of  residuals  from  a  fitted  Fourier  series  has  the  same 
form  as  the  circular  serial  correlation  from  the  mean.  T.  W.  Anderson  (1948)  gen¬ 
eralized  this  result  to  any  serial  correlation  of  residuals  from  independent  variables 
constituting  characteristic  vectors  of  the  matrix  of  the  quadratic  form  in  the  numer¬ 
ator  of  the  coefficient.  R.  L.  Anderson  suggested  “to  one  of  the  authors”  of  Durbin 
and  Watson  (1950),  (1951)  the  investigation  of  more  general  residuals.  The  disser¬ 
tation  of  Watson  (1952),  a  more  extensive  study  of  serial  correlation  of  residual::, 
was  under  the  supervision  of  R.  L.  Anderson. 

Mann  and  Wald  (1943)  derived  the  asymptotic  normality  of  the  sample  auto¬ 
covariances  in  an  autoregressive  process  under  the  assumption  of  existence  of  all 
moments  of  the  innovations.  The  asymptotic  covariances  (1.7)  of  the  sar.ple  cor¬ 
relations  for  the  linear  process  were  given  by  Bartlett  (1946)  under  the  (implicit) 
assumption  that  Evf  <  oo.  Hoeffding  and  Robbins  (1948)  proved  the  asymptotic 
normality  under  the  assumption  £v]  <  oo  for  (1.5)  being  a  finite  sum;  this  condi¬ 
tion  was  weakened  by  Diananda  (1953)  and  Walker  (1954)  to  Ev]  <  oo.  The  fact 
that  the  asymptotic  covariances  depend  only  on  the  process  correlation  function 
suggests  that  the  condition  Ev *  <  oo  is  not  necessary.  T.  W.  Anderson  (1959) 
obtained  the  limit  distribution  of  \/n(r\  —  p\)  for  an  autoregressive  process  of  order 
one  when  only  Ev]  <  oo  is  assumed.  T.  W.  Anderson  and  Walker  (1964)  found 
the  asymptotic  distribution  of  a  finite  number  of  correlations  when  (1.5)  is  satisfied 
with  hi  <  00 ■ 

The  assumption  that  the  process  {xt}  is  stationary  can  be  relaxed;  in  the  model 
(1.5)  the  ut’s  do  not  have  to  be  identically  distributed.  In  that  case  the  process 
correlations  can  still  be  defined  by  (1.9).  Moreover,  the  innovations  do  not  need 
to  be  independently  distributed.  Instead  we  assume  that  the  vt's  are  martingale 
differences.  Let  . . .  C  ?-\  C  To  C  T\  C  ...  be  an  increasing  sequence  of  cr-fields 
such  that  vt  is  .^-measurable.  We  assume  that 

(1.14)  £(vt\Ft-\)  =  0  a.s.,  <  =  ...,-1,0,1,.... 

Instead  of  Ev]  =  a2  as  for  identically  distributed  random  variables,  we  assume 
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(1.15) 


£(Vf  \Ft-\)  =  o\  a.s.,  t  — —1,0,1,..., 


(1.16) 


and 


1  n 
t=l 


2  P.a2 


>0, 


(1.17)  sup  £[Vf  I(Vf  >  a)\ft-i]  0 

<*1,2,... 

as  a  — ►  oo;  here  /(•)  is  the  indicator  function.  [7(^4)  =  1  if  the  event  A  occurs,  and 
1(A)  =  0  if  the  event  A  does  not  occur.]  Condition  (1.17)  is  a  kind  of  conditional 
uniform  integrability.  For  convenience  we  assume  that  for  some  K 


(1.18)  Sv\  <  K,  <  =  1,0,-1,...  . 

(1.19)  <  AT2,  t  ^  s. 

Finally,  to  define  the  asymptotic  second-order  moments  of  rj,  we  need  more 
information  on  the  mixed  fourth-order  moments  of  the  vt’s.  We  assume 


(1.20) 


1  " 

-  }  <T?Vt-rVt-t  2+  6rs<7*  T,  8  =  1,2,..., 

n  " 


(=1 


where  Stt  =  1  and  6rl  =  0,  r  ^  s.  In  addition  there  is  the  technical  condition 


(1.21) 


<  oo. 


«=0 


Note  that  autoregressive  moving  average  processes  satisfy  (1.21).  Hannan  and 
Heyde  (1972)  derived  the  asymptotic  distribution  of  the  r/s  when  the  Vt's  are 
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martingale  differences.  Their  conditions  are  much  stronger  than  ours.  In  particular, 
they  assume  a2  =  cr2  a.s.  and  bounded  fourth-order  moments.  A  more  detailed 
comparison  of  their  conditions  and  ours  will  be  made  later  in  this  paper. 

The  purpose  of  this  paper  is  to  give  the  very  weak  conditions  for  the  asymptotic 
normal  distribution  of  the  sample  correlations.  A  general  theorem  of  Anderson  and 
Kunitomo  (1989)  is  used.  That  theorem  is  based  on  a  martingale  central  limit 
theorem  of  Dvoretzky  (1972).  More  details  are  given  in  this  paper  than  in  Hannan 
and  Heyde  (1972). 

The  organization  of  this  paper  follows  that  of  Anderson  and  Walker  (1964). 
The  case  of  one  sample  correlation  when  p  is  known  is  proved  first.  Then  the 
theorem  is  proved  for  an  arbitrary  number  of  correlations.  Finally  the  result  is 
proved  for  unknown  p. 

Theorem.  Let  {xt}  be  defined  by  (1.5),  where  {7,}  satisfies  (1.6)  and  (1.21). 
Suppose  that  {vt}  satisfies  (1.14),  (1.15),  (1.16),  (1.17),  (1.18),  (1.19),  and  (1.20). 
Then 


(1.22) 


±N(0,W), 


Lrtf  -  PH J 

where  W  =  ( wgh )  and  wgh  is  given  by  (1.7). 

Corollary.  Under  the  conditions  of  the  theorem 


(1.23) 


Lr//  -Ph  J 


4at(0,w), 


where  W  =  ( wgh )  and  wgh  is  given  by  (1.7). 


2.  Proof  of  Theorem.  The  proof  follows  the  pattern  of  Anderson  and 
Walker  (1964).  [See  also  Hannan  and  Heyde  (1972).]  First  we  prove  that 
v/n(r<  —  pt)-^+N(0,  to//);  then  we  take  up  the  case  of  an  arbitrary  number  of  corre¬ 
lations.  Let  yt  =  xt  —  p.  Define 
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(2.1) 


(2.2) 


k 

Vtk  =  53  7.  vt-i, 

i=0 


(2.3) 


Plk 


Ek  —  l 

i=o  7»'7«+< 

e:=07? 


(2.4)  2^1  =  -4  f  J2  ytkVt+l,k  -  Plk 


ylk 


t= i 


j  / n— /  fc  n  k  \ 

=  4  EE  7>7 jVt-iVt+i-j  -  pik  EE  liliVt-xVt-j  J 
V  \t=1  ‘-J=°  ‘=i  ‘.i=o  / 

-  fn-l  k  k-l  n  k  \ 

=  I  2_>  A,  /L  7<7 k+Wt-iVt-h  -pkl  2^  2^  70^«-<t>t-j  , 

v  \,=i  i=0  *=-/  «=i  ,,>=o  / 


/ 


(2.5) 


JO*  -  _L 
"*  “  ^ 


n-l  k  k-l 


\ 


EEE  7»7 h+iVt-iVt-h  -  Plk  EE  injVt-iVt-i 


1=1  1  =  0  hm-l 

M* 


t=l  ijmO 


Note  that  terms  in  the  summation  in  (2.5)  with  t  —  i  =  t  —  h  and  t  —  i  =  t  —  j  are 
omitted. 


Lemma  1.  The  limiting  distribution  of  rj^*  as  n  — ►  oo  is  JV(0,  a*  VjA)  where 


(2.7) 


4*  =  X^7'*'7'<+'+r  +  V.Vi+l-r  -  Plkil'rt'i+r  +  V.Vi-r)] 


t=0 
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and  7 \  =  7,  for  0  <  *  <  k  and  7^  =  0  otherwise  (that  is,  for  i  <  0  and  i  >  k ). 


Proof  of  Lemma  1.  By  changing  indices  of  summation  we  can  write 


(2-8)  &  =  ± 


' n  —  l  k  /  k  k+l 

££  £  +  /+r^-,U<-i-r  +  ^2  ViVi+Z-r^-.^-i+r 

.  t=l  «=0  \r=l  r=l 

n  k  /  k  k  \ 

~  Ptk  +  £  7,'7!-rVt-iV«-i+r 

<=1  t=0  \r=l  r=l  / 


Another  change  of  indices  and  the  addition  and  subtraction  of  a  finite  number  of 
terms  (the  number  not  depending  on  n )  changes  (2.8)  to 


(2.9) 


.  n  k+l 

-4=  EE' 


-m 


where  x[l)  =  u«-r-  We  show  that  (2.9)  has  the  limiting  distribution 

N(0,a2Vik)  by  means  of  Theorem  1  of  Anderson  and  Kunitomo  (1989).  Condi¬ 
tion  (1.17)  implies 


(2.10) 


sup 

t=-k+ 1,. 


0. 


[See  the  proof  of  Theorem  2.23  of  Hall  and  Heyde  (1980).]  Therefore 


(2.11) 


sup 

<=!,..  .,n 


n 


Furthermore  (1.16)  and  (1.17)  imply 


(2.12) 


a 


2 


[See  Anderson  and  Kunitomo  (1989),  Theorem  2,  for  example.]  Then 
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(2.13)  -  ir  vt-rvt-a  0,  r^j. 

n£i 

[Application  of  Theorem  1  of  Anderson  and  Kunitomo  (1989),  for  example,  with 
vt-t  replaced  by  vt  and  vt-r  replaced  by  zt  for  s  <  r  shows  that  %/n  times  the 
left-hand  side  of  (2.13)  has  a  limiting  normal  distribution.]  Thus 


(2.14) 


=  Vlk. 


The  conditions  of  Theorem  1  of  Anderson  and  Kunitomo  (1989)  are  satisfied  with 
zt  =  x^.  This  completes  the  proof  of  Lemma  1.  | 


Let 


(2.15) 


-  /  n—l  oo  n  oo 

\  f =  1  *,)  *0  t=  1  i.jmO 


JiJjVt-iVt-j 


&J-1  »*> 

Lemma  2.  The  limiting  distribution  of  Zn  *  as  n  — »  oo  is  N(0,  <r4Vj),  where 


(2.16) 


V,= 


tvu. 


Proof  of  Lemma  2.  The  limit  of  N(0,cr4Vik )  is  jV(0,  cr4Vi)  as  k  — ►  oo  since 


(2.17)  V,k 


r=l  v.  i=0 


i  7i+/+r  7i  7j+/_r  Pl{7i  7t+r  "b  7i 


=,/'’ 


where  7*  =  7,  for  0  <  i  and  7*  =  0  for  1  <  0.  To  complete  the  proof  of  Lemma  2 
we  shall  show  that  z„^*  —  z^l*  0  as  k  — ►  00  uniformly  in  T.  Let 
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(2.18) 

Then 


utk  =  yt  -  ytk  = 

<=t+i 

n  —  l 


(2.19)  -  2nl*  =  -7=  y2  l(y<fc  +  utk)(yt+i,k  +  ut+i,k )  -  ytfcy<+/,t] 

vn1^i 

n 

+  -7=  [-/»i(yife  +  utfc)2  +  /3/jfci/tjfc] 

v"1=! 

1  n-» 

=  —7=  Y"  fu<tyi+/,Jt  +  yt,kut+i,k  +  utkut+i,k] 
s/n 

n 

+  —r=  Y]  [(p/fc  -  Pl)Vtk  -  ZptytkUtk  -  PlU2tk], 

; 

where  the  prime  on  Y,'  denotes  that  terms  vtvs  with  t  =  s  are  omitted.  Let 


n  — / 


(270) 


Ti  ~Y1  utkyt+i,k, . . . ,  T6  =  -pi  ^2  utk- 


<= 1 


t=i 


Then  (2.19)  is  (l/y/n)  YUi  Tk. 
Consider,  for  example, 


(2.21) 


n  00 

=  2Yj  Yj  7.7 jVt-iVt-j. 

t=l  ij-k  +  l 
•<J 


(If  p/  =  0,  T\  =  T5  =  7(5  =  0.)  The  expected  value  of  the  square  of  (2.21)  divided 
by  2  is 


(2.22) 


j  n  00 

=  -€  Y1  Y  'yaj'Yi'7j'vt-ivt-jVt'-i'Vt'-ji . 


M'  =  1  +  l 
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By  the  Cauchy-Schwaxz  inequality 


(2.23) 


E\vt-xVt-iVf-i>Vt'-i'  \  <  yj Ev^_{v^_j Ev\, _v vf, _y 


<  K z. 


Then  (2.22)  is 


^  oo  n 

(2-24)  “  7«7j7«'7i'  Zvt-jVt-i-U'-i^Eiv^ilft-i-i), 

tj*  mtk+l 

where  the  sum  on  t  is  vacuous  unless  1  <  t  —  i  +  i'  <  n.  Use  of  (2.23)  shows  that 
(2.24)  is  not  greater  than 


(2.25) 


K 2. 


This  quantity  is  made  arbitrarily  small  by  taking  k  sufficiently  large.  Hence  Tf,  A  0 
uniformly  in  n  as  k  — ►  oo. 

For  T4  we  consider 


<2-26> 

V  V  t=l  i,jm 0 


•<j 

n  k—1  k 


=  rm  E  £  E  7i7yv.-iv.-i 

V  t=l  i=0  i=i+l 
2  n  fc— 1  k—i 

7i7»+fcVt-<W<-,-A 

V  <=1  i=0  /»=1 

*-l  -  n  / k—i  \ 

=  2  E 7i  Y,  (  E  7i+»v.-i-»  )  v,-.. 

i=o  v  t=l  \fc=l  / 


For  each  t  the  term  in  (2.26)  that  is  multiplied  by  7<  has  a  limiting  normal  distribu¬ 
tion  [by  Theorem  1  of  Anderson  and  Kunitomo  (1989)  with  zt  =  7*-+-fcV«— «— fc] » 

and  hence  the  sum  on  i  has  a  limiting  distribution.  Since  pik  — ►  pi,  the  term  T4  A  0. 
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It  follows  from  the  Cauchy-Schwarz  inequality  and  the  behavior  of  ^  I/a/V” 
and  u?t/\/™  that  T5  0.  That  the  first  three  terms  converge  stochastically  to 
0  follows  similarly.  I 

Lemma  3.  The  limiting  distribution  of  z ^  is  N(0,a4Vi). 

Proof  of  Lemma  3.  We  have 


(2.27) 


where 


(2.28) 


zO)  _  z(0* 


n— /  00 


=  4;  EE"> 

V  '•  |_t=1  ,_o  t=l  i=0 
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The  second  term  on  the  right-hand  side  of  (2.27)  is  pi  times 


(2.30)  E f;7?T(o» . J=  fa  ±v]+  £  7?  g 

V  1=0  V  \«=0  «=!-«  «=n+l  3=1 -i  / 


The  expected  value  of  the  first  pair  of  terms  on  the  right-hand  side  of  (2.30)  is  not 
greater  than 


for  m  <  n.  The  second  term  on  the  right-hand  side  of  (2.31)  is  made  arbitrarily  small 
by  taking  m  large  enough.  The  first  term  is  made  arbitrarily  small  by  taking  n  large 
enough,  given  m.  The  second  pair  of  terms  on  the  right-hand  side  of  (2.30)  is  treated 
similarly.  Then  Markov’s  inequality  implies  that  (2.30)  converges  stochastically  to 
0. 

The  absolute  value  of  the  first  term  on  the  right-hand  side  of  (2.27)  has  expected 
value  not  greater  them 
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The  argument  used  for  (2.31)  shows  that  the  right-hand  side  of  (2.32)  can  be  made 
arbitrarily  small  uniformly  in  n.  | 


Lemma  4.  Under  the  assumptions  of  the  theorem 


(2.33) 
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Proof  of  Lemma  4.  We  can  write  co  as 
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The  last  term  in  (2.34),  which  is  nonnegative,  has  expected  value 
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(2.35) 


This  can  be  made  arbitrarily  small  by  taking  k  sufficiently  large. 
The  first  term  of  (2.34)  is 


n  k 


(2.36) 
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The  first  term  on  the  right-hand  side  of  (2.36)  converges  in  probability  to  a2  7 2, 

the  limit  of  which  is  a2  ]C*^o7?  as  fc  — »  00.  The  second  term  in  (2.36)  is  2/>/n 
times 
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Addition  and  subtraction  of  fc(fc  —  1)  terms  changes  (2.37)  into 
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Theorem  1  of  Anderson  and  Kunitomo  (1989)  with  zt  =  E>=o  E*=i  7i7 j+hVt-h 
shows  that  the  limiting  distribution  of  (2.38)  is  normal  with  finite  variance.  Hence 
the  second  term  in  (2.36)  converges  stochastically  to  0. 

The  second  term  in  (2.34)  is  in  absolute  value 

1  n 

(2.39)  2  -J2ytkutk  <2 

n7=t 

which  converges  stochastically  to  0  by  the  preceding  results.  The  lemma  follows.  | 
Lemma  5.  Under  the  conditions  of  the  theorem  y/n(ri  —  pi)  —*N(0,  wu). 
Proof  of  Lemma  5.  We  have 
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Lemma  5  follows  from  Lemmas  1  to  4.  | 


The  theorem  is  proved  by  showing  that 
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has  a  limiting  normal  distribution  for  any  constants  a\ , . . . ,  oh-  The  generalization 
of  Lemma  1  pertains  to  E^=i  a*2rnfe^ » which  is  modified  by  addition  and  subtraction 
of  a  finite  number  of  terms  (the  number  not  depending  on  n)  to 


n  k+H 


(2.42) 
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where 


(2.43) 


Lemmas  2  and  3  show  that 


<5  =  E“‘^ 


(2.44) 


uniformly  in  n  as  k  — ►  oo.  Then  the  theorem  follows. 


3.  Proof  of  Corollary. 


Lemma  6.  Under  the  conditions  of  the  theorem 


-  p 

x—*n. 


Proof  of  Lemma  6.  We  have 
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Then  (3.1)  follows  by  Tchebycheff’s  inequality. 


I 


Proof  of  Corollary.  We  have 


(3.3) 
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Since  the  set  y/n[c*  —  <r(l)], . . . ,  \/n[Cff  —  cr(H)\  has  the  same  limiting  distribution 
as  the  set  y/n[ci  —  <t(1  )],... ,  y/n[cH  —  &{H)]  and  cj-^<r(0),  the  limiting  distribution 
of  the  set  \/n(rJ  —  pi),... ,  y/n(r*H  —  pn)  is  the  same  as  the  limiting  distribution  of 
the  set  V™(ri  “  Pi )>•••,  -  pH ).  | 


4.  Discussion 

4.1.  Assumptions  on  Moments  of  Innovations.  Although  the  asymp¬ 
totic  distribution  of  autocovariances  may  depend  on  finiteness  or  boundedness  of 
fourth-order  moments,  the  asymptotic  distribution  of  the  autocorrelations  has  been 
demonstrated  here  on  the  basis  of  boundedness  of  second-order  moments  and  of 
mixed  fourth-order  moments;  these  conditions  are  weaker  than  the  condition  of 
boundedness  of  the  pure  fourth-order  moments.  In  fact  the  boundedness  of  second- 
order  moments  is  used  in  Lemmas  3,4,  and  6,  and  the  boundedness  of  mixed  fourth- 
order  moments  is  applied  in  Lemma  2;  these  conditions  may  be  slightly  unnecessarily 
strong.  However,  (1.20),  which  involves  mixed  fourth-order  products,  is  essential 
to  obtain  the  covariances  of  the  limiting  distributions.  It  should  be  noted  that  the 
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conditions  do  permit  heterogeneity  of  variances.  In  the  case  that  the  innovations 
are  independently  identically  distributed  only  the  second-  order  moment  is  assumed 
finite,  but  that  implies  that  the  mixed  fourth-order  moments  are  finite  and  are  de¬ 
termined  by  the  second-order  moments  (and  the  fact  that  the  first-order  moment  is 
0). 

4.2.  Comparison  with  Autoregression.  In  the  case  of  the  process  defined 
by  (1.10)  the  boundedness  of  second-order  moments  and  mixed  fourth-order  mo¬ 
ments  is  not  needed.  Conditions  (1.14),  (1.15),  (1.16),  (1.17),  and  (1.20)  suffice.  In 
fact,  it  is  not  assumed  that  Sv\  <  oo.  See  Anderson  and  Kunitomo  (1989). 

4.3.  A  More  General  Mixed  Fourth-Order  Moment  Limit.  Instead  of 
(1.20)  we  can  assume 

1  n 

(4.1)  -V 'crtvt-rVt-,  TraaA,  r,s  =  1,2,..., 

n  t=i 

where  {rr,}  is  arbitrary.  Then  in  the  theorem  and  corollary  wgh  given  by  (1.17)  is 
replaced  by 

OO 

(4.2)  Tr»{Pr+g  +  Pr—g  ~  %PrPg)(Pr+h  +  Pr-h  ~  2 PrPh)- 
r,*=l 

The  major  change  in  the  derivation  is  that  a  generalization  of  Theorem  1  of  Ander¬ 
son  and  Kunitomo  (1989)  is  applied  to  obtain  a  variance  in  Lemma  1  of 

k+l 

(4-3)  E 

r,«=l 

4.4.  Comparison  with  a  Theorem  of  Hannan  and  Heydc.  As  noted  in 
the  introduction,  Hannan  and  Heyde  (1972)  generalized  the  theorem  of  Anderson 
and  Walker  (1964)  to  innovations  being  martingale  differences.  The  conditions  in 
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the  present  paper  [  as  in  Anderson  and  Kunitomo  (1989)]  are  weaker  than  those  of 
Hannan  and  Heyde.  In  both  papers  (1-6),  (1.14),  and  (1.21)  are  assumed.  Instead 
of  (1.17),  (1.18),  and  (1.19),  Hannan  and  Heyde  assume  that  there  exists  a  constant 
c  and  a  random  variable  X  such  that 


(4.4)  Pr{|t>t|  >  u}  <  c  Pr{|X|  >  u},  Vu  >  0, 

and 


(4.5)  £ X4  <  oo. 

This  condition  implies  that  the  pure  fourth-order  moments  of  the  innovations  axe 
bounded.  Instead  of  (1.16)  they  assume 

(4.6) 
and 


(4.7)  £v2  =  a2. 

In  addition  to  (4.1)  they  assume 


(4.8)  £v2tvt-rvt-B  =  ff4Tra,  r, s  =  1, 2, . . . . 

The  conditions  of  Hannan  and  Heyde  are  considerably  stronger  than  those  of  this 
paper  in  that  they  assume  that  variances  and  mixed  fourth-order  moments  of  the 
innovations  are  homogeneous. 
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